CLAIMS 



What is claimed is: 

1. In a communication network, a method of TCP state 
5 migration comprising the steps of: 

a) establishing a TCP/IP communication session 
between a client computer and a first server computer, said 
first server computer part of a plurality of server 
computers forming a web cluster containing information, 

10 said communication session established for the transfer of 
data contained within said information; 

b) handing off said communication session to a 
selected server computer from said first server computer 
over a persistent control channel using TCP handof f modules 

15 that are dynamically loadable within TCP/IP stacks in 
operating systems located at both said first server 
computer and said selected server computer, that implement 
a TCP handoff protocol that works within kernel levels of 
an existing TCP/IP protocol; and 

20 c) migrating a first TCP state of said first server 

computer to said selected server computer, and a second TCP 
state of said selected server computer to said first server 
computer over said control channel. 



25 2. The method as described in Claim 1, wherein said 

step a) comprises the steps of: 

receiving a SYN packet from said client at a first 
BTCP module located at said first server computer; 
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sending said SYN packet upstream to a first TCP module 
located above said first BTCP module in a first operating 
system of said first server computer; 

receiving a first SYN/ACK packet from said first TCP 
5 module; 

parsing said first initial TCP state from said first 
SYN/ACK packet^ including a first initial sequence number 
for said first TCP module associated with said TCP/IP 
communication session; 
10 sending said SYN/ACK packet to said' client; 

receiving an ACK packet from said client at said first 
BTCP module; 

sending said ACK packet to said first TCP module; 

receiving a web request packet associated with said 
15 TCP/IP communication session at said first BTCP module at 
said first server computer; 

storing said SYN, ACK and said web request packet at 
said first server computer - 

20 3. The method as described in Claim 2, wherein said 

step b) comprises the steps of: 

examining content of said web request packet; 
determining which of said plurality of server 
computers, a selected server computer, can best process 
25 said WEB request packet, based on said content; 

sending a handoff request from said first BTCP module 
to a second BTCP module at said selected server computer 
over said control channel, if said selected server computer 
is not said first server computer; 
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including said SYN packet and said ACK packet in said 
handoff request packet; 

changing a first destination IP address of said SYN 
packet to a second IP address of said selected server 
5 computer, at said second BTCP module; 

sending said SYN packet to said second TCP module; 

receiving a second SYN/ACK packet at said second BTCP 
module; 

parsing said second initial TCP state from said second 
10 SYN/ACK packet, including a second initial sequence number, 
for said second TCP module, that is associated with said 
TCP/IP communication session; 

changing a second destination IP address of said ACK 
packet to said second IP address, at said second BTCP 
15 module; 

updating said ACK packet to reflect said second TCP 
state of said selected server computer in said 
communication session; 

sending said ACK packet that is updated to said second 
20 TCP module; and 

sending a handoff acknowledgment message to said first 
BTCP module. 

4. The method as described in Claim 3, wherein step 
25 c) comprises the steps of: 

monitoring traffic associated with establishing said 
TCP/IP communication session in step a) , at said first BTCP 
module, to parse a first initial TCP state of said first 
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server computer, said first initial TCP state associated 
with said TCP/IP communication session; and 

migrating said first initial TCP state to said second 
BTCP module over said control channel by including said 
5 first initial TCP state in said handoff request packet, 
said first initial TCP state including a first sequence 
number, such that said second BTCP module can calculate 
said first TCP state for said first server computer in said 
TCP/IP communication session. 

10 

5. The method as described in Claim 3, wherein step 
c) comprises the steps of: 

monitoring traffic associated with handing off said 
TCP/IP communication session in step e) , at said second 

15 BTCP module, to parse a second initial TCP state of said 
selected server computer, said second initial TCP state 
associated with said TCP/IP communication session; and 

migrating said second initial TCP state of said 
selected server computer to said first BTCP module by 

20 including said second initial TCP state in said handoff 
acknowledgment packet, said second initial TCP state 
including a second initial sequence number, such that said 
first BTCP module can calculate said second TCP state for 
said selected server computer in said TCP/IP communication 

25 session. 

6. The method as described in Claim 2, comprising the 
further steps of: 
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intercepting a connection indication message sent from 
said first TCP module to an application layer above said 
first TCP module at a first upper-TCP (UTCP) module, said 
connection indication message sent by said first TCP module 
5 upon establishing said communication session; and 

holding said connection indication message at said 
first UTCP module. 

7. The method as described in Claim 6, wherein said 
10 method comprises the further steps of: 

sending a reset packet from said first BTCP module upon 

receiving said handoff acknowledgment packet to said first 

TCP modules- 
discarding said connection indication message at said 
15 first UTCP modules- 
receiving incoming data packets from said client at 

said first BTCP modules- 
changing said destination addresses of said incoming 

data packets to said second IP address; 
20 updating sequence numbers and TCP checksum in said 

data packets to reflect said second TCP state of said 

selected server computer; and 

forwarding said data packets to said selected server 

computer. 

25 

8. The method as described in Claim 6, comprising the 
further steps of: 

sending notification from said first BTCP module to 
said first UTCP module to release said connection indication 
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message^ if said selected server computer is said first 
server computer; 

sending incoming data packets^ including said web 
request packet, from said client, received at said first 
5 BTCP module, upstream. 



9. The method as described in Claim 1, comprising 
the further step of: 

intercepting outgoing response packets from said 
10 selected server computer at a second bottom TCP (BTCP) 
module located at said selected server computers- 
changing source addresses of said response packets to 
a first IP address of said first server computer; 

updating sequence numbers and TCP checksum in said 
15 response packets to reflect said first TCP state of said 
first server computer; and 

sending said response packets to said client. 

10. The method as described in Claim 1, comprising 
20 the further steps of: 

monitoring TCP/IP control traffic for said 
communication session at said second BTCP module; 

understanding when said communication session is 
closed at said second server computer; 
25 sending a termination message to said first server 

computer over said control channel; 

terminating said TCP/IP communication session at said 
first server computer by terminating a forwarding mode at 
said first BTCP module; and 
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freeing data resources associated with said 
communication session at said first server computer. 

11. In a communication network, a method of TCP 
5 state migration comprising the steps of: 

a) establishing a TCP/IP communication session 
between a client computer and a first server computer, said 
first server computer part of a plurality of server 
computers forming a web cluster containing information, 

10 said communication session established for the transfer of 
data contained within said information; 

b) monitoring traffic associated with establishing 
said TCP/IP communication session to understand a first 
initial TCP state of said first server computer associated 

15 with said TCP/IP communication session, at a first bottom- 
TCP (BTCP) module at said first server computer; 

c) receiving a web request associated with said 
TCP/IP communication session at said first BTCP module at 
said first server computer; 

20 d) examining content of said web request; 

e) determining which of said plurality of server 
computers, a selected server computer, can best process 
said web request, based on said content; 

f) handing off said communication session to said 
25 selected server computer from said first server computer 

over a persistent control channel, if said selected server 
computer is not said first server computer; 

g) monitoring traffic associated with handing off 
said TCP/IP communication session to understand a second 
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initial TCP state of said selected server computer 
associated with said TCP/IP cormnunication session, at a 
second BTCP module at said selected server computer; 

h) migrating said first initial TCP state to said 
5 selected server computer over said control channel, such 

that said second BTCP module can calculate a first TCP 
state for said first server computer in said TCP/IP 
communication session; 

i) sending a second initial TCP state of said 

10 selected server computer to said first BTCP module, such 
that said first BTCP module can calculate a second TCP 
state for said selected server computer in said TCP/IP 
communication session; 

j ) forwarding data packets received at said first 

15 BTCP module from said client to said selected server 

computer, by changing said data packets to reflect said 
second TCP state and a second IP address of said selected 
server computer; 

k) sending response packets from said selected server 

20 computer directly to said client computer by changing said 
response packets to reflect said first TCP state and a 
first IP address of said first server computer; and 

1) terminating said TCP/IP communication session at 
said first server computer when said TCP/IP communication 

25 session is closed. 

12. The method as described in Claim 11, wherein 
said step a) comprises the steps of: 
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receiving a SYN packet from said client at said first 
BTCP module; 

sending said SYN packet upstream to a first TCP module 
located above said first BTCP module in a first operating 
5 system of said first server computers- 
receiving a first SYN/ACK packet from said first TCP 
module; 

parsing said first initial TCP state from said first 
SYN/ACK packet, including a first initial sequence number 
10 for said first TCP module associated with said TCP/IP 
communication session; 

sending said SYN/ACK packet to said client; 

receiving an ACK packet from said client at said first 
BTCP module; 

15 sending said ACK packet to said first TCP module; 

storing said SYN, ACK and said web request at said 
first server computer. 

13. The method as described in Claim 11, wherein said 
20 step e) comprises the steps of: 

sending a handoff request packet from said first BTCP 
module to said second BTCP module over said control 
channel; 

including said SYN packet and said ACK packet in said 
25 handoff request packet; 

changing a first destination IP address of said SYN 
packet to a second IP address of said selected server 
computer^ at said second BTCP module; 

sending said SYN packet to said second TCP module; 
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receiving a second SYN/ACK packet at said second BTCP 

modules- 
parsing said second initial TCP state from said second 

SYN/ACK packet s including a second initial sequence number^ 
5 for said second TCP module^, that is associated with said 

TCP/IP communication session; 

changing a second destination IP address of said ACK 

packet to said second IP address, at said second BTCP 

module; 

10 updating said ACK packet to reflect said second TCP 

state of said selected server computer in said 
communication session; 

sending said ACK packet that is updated to said second 
TCP module; and 

15 sending a handoff acknowledgment message to said first 

BTCP module. 



14, The method as described in Claim 13, wherein 
said ACK packet includes said first initial TCP state of 
20 said first server computer as provided for in step f ) . 



15 • The method as described in Claim 13, wherein 
said handoff acknowledgment includes said seoond initial 
TCP state of said second server computer, including a 
25 second initial sequence number, for said second TCP module, 
that is associated with said TCP/IP communication session 
as provided for in step i) . 
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16. The method as described in Claim 13, comprising 
the further steps of: 

intercepting a connection indication message sent from 
said first TCP module to an application layer above said 
5 first TCP module at a first upper-TCP (UTCP) module, said 
connection indication message sent by said first TCP module 
upon establishing said communication session; and 

holding said connection indication message at said 
first UTCP module. 

10 

17. The method as described in Claim 16, wherein step 
h) comprises the further steps of: 

sending a reset packet from said first BTCP module upon 
receiving said handoff acknowledgment packet to said first 
15 TCP modules- 
discarding said connection indication message at said 
first UTCP modules- 
receiving incoming data packets from said client at 
said first BTCP module; 
20 changing said destination addresses of said incoming 

data packets to said second IP address; 

updating sequence numbers and TCP checksum in said 
data packets to reflect said second TCP state of said 
selected server computer; and 
25 forwarding said data packets to said selected server 

computer. 



18. The method as described in Claim 11, wherein 
step k) comprises the steps of: 
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intercepting outgoing response packets from said 
selected server computer at said second BTCP module; 

changing source addresses of said response packets to 
said first IP address; 
5 updating sequence numbers and TCP checksum in said 

response packets to reflect said first TCP state of said 
first server computer; and 

sending said updated response packets to said client, 

10 19. The method as described in Claim 11, wherein 

step 1) comprises the steps of: 

monitoring TCP/IP control traffic for said 
communication session at said second BTCP module; 

understanding when said communication session is 
15 closed at said second server computer; 

sending a termination message to said first server 
computer over said control channel; 

terminating a forwarding mode at said first BTCP 
module; and 

20 freeing data resources associated with said 

communication session at said first server computer. 

20. The method as described in Claim 16, comprising 
the further steps of: 
25 sending notification from said first BTCP module to 

said first UTCP module to release said connection indication 
message, if said selected server computer is said first 
server computer; and 
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sending incoming data packets, including said web 
request, from said client, received at said first BTCP 
module, upstream. 



5 21. The method as described in Claim 11, wherein 

each of said plurality of server computers is constructed 
similarly including BTCP modules located downstream from 
TCP modules, and UTCP modules located upstream from TCP 
modules. 

10 

22, The method as described in Claim 12, comprising 
the further step of storing said web request, said SYN 
packet, said ACK packet, and said web request at said first 
server computer. 

15 

23. The method as described in Claim 22, wherein 
said control channel allows for communication between all 
UTCP modules. 

20 24. The method as described in Claim 11, wherein 

said plurality of server computers is coupled together over 
a wide area network in said communication network. 

25. The method as described in Claim 11, wherein 
25 said information is partitioned/partially replicated 

throughout each of said plurality of server computers, 

26. A server computer comprising: 
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an upper TCP (UTCP) module located above a TCP module 
in an operating system of said server computer; 

a bottom TCP (BTCP) module located below said TCP 
module, said UTCP,. TCP, and BTCP modules implementing a 
5 method of handing off a communication session between a 

first node and second node in a cluster network that works 
within the kernel level of an existing TCP/IP protocol, by 
migrating TCP states associated with said first and second 
nodes . 

10 

27. The server computer as described in Claim 26, 
wherein said method comprises the steps of: 

a) establishing a TCP/IP communication session 
between a client computer and said server computer, said 

15 first node, said server computer part of a plurality of 
server computers forming said cluster network containing 
information, said communication session established for the 
transfer of data contained within said information; 

b) receiving a web request associated with said 

20 TCP/IP communication session at a first BTCP module at said 
server computer; 

c) examining content of said web request; 

d) determining which of said plurality of server 
computers, a selected server computer, can best process 

25 said web request, based on said content; 

e) handing off said communication session to said 
selected server computer from said server computer over a 
persistent control channel, if said selected server 
computer is not said server computer; and 
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f) migrating a first TCP state of said server 
computer to said selected server computer, and sending a 
second TCP state of said selected server computer to said 
server computer over said control channel. 

5 

28. The server computer as described in Claim 27, 
wherein step a) of said method comprises the steps of: 

receiving a SYN packet from said client at said BTCP 
module; 

10 sending said SYN packet upstream to, said TCP modules- 

receiving a first SYN/ACK packet from said TCP module; 
parsing a first initial TCP state from said first 
SYN/ACK packet, including a first initial sequence number 
for said TCP module associated with said TCP/IP 
15 communication session; 

sending said SYN/ACK packet to said client; 
receiving an ACK packet from said client at said BTCP 
module; 

sending said ACK packet to said TCP module; 
20 storing said SYN, ACK at said server computer. 



29. The server computer as described in Claim 28, 
wherein said method comprises the steps of: 

sending a handoff request packet from said BTCP module 
25 to a second BTCP module over said control channel, said 
second BTCP module located below a second TCP module in a 
second operating system at said selected server computer; 

including said SYN packet and said ACK packet in said 
handoff request; 
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receiving a handoff acknowledgment message at said BTCP 
module from said second BTCP module. 

30. The server computer as described in Claim 29, 

5 wherein said step f) of said method comprises the steps of: 
monitoring traffic associated with establishing said 
TCP/IP communication session in step a) , at said BTCP 
module, to parse a first initial TCP state of said server 
computer, said first initial TCP state associated with said 
10 TCP/IP communication session; and 

migrating said first initial TCP state to said second 
BTCP module over said control channel by including said 
first initial TCP state in said handoff request, said first 
initial TCP state including a first sequence number, such 
15 that said second BTCP module can calculate said first TCP 

state for said server computer in said TCP/IP communication 
session, 

31. The server computer as described in Claim 29, 
20 wherein said method comprises the further steps of: 

intercepting a connection indication message sent from 
said first TCP module to an application layer above said 
first TCP module at a first upper-TCP (UTCP) module, said 
connection indication message sent by said first TCP module 
25 upon establishing said communication session; and 

holding said connection indication message at said 
first UTCP module. 
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32. The computer system as described in Claim 31, 
wherein said method comprises the further steps of: 

sending a reset packet from said first BTCP module upon 
receiving said handoff acknowledgment packet to said first 
TCP modules- 
discarding said connection indication message at said 

first UTCP modules- 
receiving incoming data packets from said client at 

said first BTCP modules- 
changing said destination addresses of said incoming 

data packets to said second IP address; 

updating sequence numbers and TCP checksum in said 

data packets to reflect said second TCP state of said 

selected server computer; and 

forwarding said data packets to said selected server 

computer. 

33. The server computer as described in Claim 31, 
said method comprising the further steps of: 

sending notification from said BTCP module to said UTCP 
module to release said connection indication message, if 
said selected server computer is said server computer; 

sending incoming data packets, including said web 
request, from said client, received at said first BTCP 
module, upstream. 

34. The server computer as described in Claim 26, 
said method comprising the further steps of: 
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receiving a handoff request from a first BTCP module 
located at a first server computer within said cluster 
network over a persistent control channel, said first 
server computer having established a communication session 
5 with a client computer, said communication session 

established for the transfer of data contained within said 
server computer, said handoff request including a SYN 
packet and an ACK packet, said SYN and ACK packet used for 
establishing said communication session between said client 
10 and said first server computer, said ACK ^packet including a 
first initial TCP state of said first server computer in 
said communication session, including a first initial TCP 
sequence number; 

changing a first destination IP address of said SYN 
15 packet to a second IP address of said server computer, at 
said BTCP module; 

sending said SYN packet to said TCP module; 
receiving a SYN /ACK packet at said second BTCP module; 
parsing a second initial TCP state from second SYN/ACK 
20 packet, including a second initial sequence number, for 

said TCP module, said second initial TCP state associated 
with a second TCP state for said server computer in said 
TCP/IP communication session; 

changing a second destination IP address of said ACK 
25 packet to said second IP address, at said BTCP module; 

updating said ACK packet to reflect said second TCP 
state of said selected server computer in said 
communication session; 
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sending said ACK packet that is updated to said TCP 
module; and 

sending a handoff acknowledgment message to said first 
BTCP module over said control channel . 

5 

35. The server computer as described in Claim 34^ 
wherein said method comprises the further steps of: 

monitoring traffic associated with handing off said 
TCP/IP communication session to said seirver computer, at 

10 said BTCP module, to parse said second initial TCP state of 
said server computer, said second initial TCP state 
associated with said TCP/IP communication session; and 

sending said second initial TCP state of said server 
computer to said first BTCP module by including said second 

15 initial TCP state in said handoff acknowledgment, said 
second initial TCP state including a second initial 
sequence number, such that said first BTCP module can 
calculate said second TCP state for said server computer in 
said TCP/IP communication session. 

20 

36. The server computer as described in Claim 34 
wherein said method comprises the further steps of: 

intercepting outgoing response packets from said 
server computer at said second BTCP module; 
25 changing source addresses of said response packets to 

said first IP address; 

updating sequence numbers and TCP checksum in said 
response packets to reflect said first TCP state of said 
first server computer; and 
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sending said response packets to said client. 



37. The server computer as described in Claim 34, 
wherein said method comprises the further steps of: 
5 monitoring TCP/IP control traffic for said 

communication session at said BTCP modules- 
understanding when said communication session is 
closed at said server computer; and 

sending a termination message to said first server 
10 computer over said control channel . 
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